25 



PHNL000341 • • ■ • 

1 14.05,2001 
Lighting control device and method of controlling lighting 



The invention relates to a lighting control device comprising a sensor, which is 
capable of measuring electromagnetic radiation in a room, and control means which are 
capable of controlling the lighting in the room in response to the measured radiation values. 

5 In this connection, "electromagnetic radiation" is to be taken to mean, in 

particular, visible light and near infrared light. It is well known to measure and control the 
light level in an office by means of a sensor comprising a single photocell which is mounted 
at the ceiling and monitors the workplace(s) at a specific observation angle. A drawback of 
the known sensor resides in that it measures an integral light intensity in the observation 

1 0 range. If windows are situated, partly or entirely, within the observation range, then the 
amount of light reaching the sensor through the window (for example originating from 
reflections of a parking space outside the building), may become a dominant factor in the 
overall output signal of the light sensor. As a result thereof, it may become too dark inside 
due to the action of the light control This possible disturbance depends to a substantial 

15 degree on the weather conditions and the brightness outside. A similar disturbance may occur 
if direct sunlight enters through the windows, leading to extremely bright light patches on the 
window pane, desks or even on the floor. These light patches are almost always situated 
within the observation range of the sensor. 

20 Apart from a detector which does not have the above-mentioned drawbacks, 

there is a need for lighting which can be controlled by means of a remote control. In addition, 
there is a need for lighting which is controlled automatically in dependence on the presence 
of people. For this purpose, in the known sensor, respectively, an infrared cell and a motion 
detector must be installed next to the photocell. 



It is an object of the invention to provide an efficient, practical and accurate 
lighting control device, which is capable of carrying out a number of the above frmctions at 
low costs and which leads to a reduction of the drawbacks of the known systems. 
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To achieve this, the sensor comprises a video sensor, for example a CCD 
(Charged Coupled Device) sensor, which is capable of producing an electronic (video) image 
of the room. Such a sensor is frequently used in video cameras and, as a result of the large 
numbers, can be economically manufactured. The electronic image can be analyzed by the 
5 control means, by means of which the lighting in the room can be accurately adjusted. 

Preferably, the sensor and the control means can suitably be used to control 
the hghting in response to the measured radiation values of both visible light and infrared 
radiation. This enables, for example, the lighting to be controlled also by means of an 
10 infrared remote control which is directed at the sensor. For this purpose, preferably, the 

control means can respond to signals emitted by a remote control. The device is also capable 
of detecting the presence of himan beings, by means of infrared detection, if it is dark in the 
room. For this purpose, for example, a near infrared light source should be present in the 
space, to which the video sensor is susceptible. 

15 

Preferably, the control means are capable of controlling the lighting in 
response to the contrast between the values of the image. The control means preferably are 
also capable of controlling the lighting in response to the radiation values of visible light in 
predetermined parts of the image, so that parts disturbing the image, such as parts of the room 
20 that are brightly lit by the sun, can be ignored. These parts can be determined either 
automatically or they can be entered by hand. 

Preferably, the control means are capable of controlling the lighting in 
response to the color temperature values of the image. By virtue thereof, in conjimction with 
25 a luminaire by means of which the color temperature can be varied, it becomes possible to 
bring about a constant color temperature or, conversely, dependent upon the objective, 
different color temperatures of the lighting can be adjusted. 

Preferably, the control means include motion detection means, which enable 
30 the lighting to be switched on when a person enters the room. More preferably, the control 
means comprise object recognition means which can recognize a specific object in the CCD 
video image, so that also non-moving objects (for example motionless people) are observed. 
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The invention further relates to a method of controlling the lighting in a room, 
wherein the electromagnetic radiation in a room is measured by means of a sensor, the 
lighting in the room is controlled, by means of control means, in response to the measured 
radiation values, and the electromagnetic radiation is measured by a CCD (Charged Coupled 
5 Device) sensor producing an electronic image of the room. 

These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiment(s) described hereinafter. 



10 

In the drawings: 

Fig. 1 shows a video image observed by a CCD sensor; 

Fig. 2 shows, respectively, (A) the video signal of a video line of the video 
image shown in Fig. 1, (B) a comparator output associated with the video signal and (C) the 
1 5 resulting, processed video signal; 

Fig. 3 shows a processing diagram of the signals of Fig. 2; and 

Figs. 4A-4H show a series of video images illustrating the object recognition 
process within the scope of the invention. 

20 Fig. 1 shows an image as can be observed by a CCD sensor which is provided 

with a lens (the CCD sensor can thus also be referred to as a CCD camera), which CCD 
sensor, in conjunction with control means, forms part of a lighting control device and is 
mounted at the ceiling. The lighting control device is connected to the various luminaires 
situated in the room, and is capable of adjusting the intensity with which these luminaires 

25 illuminate the different spots in the room. The object is to achieve the best possible 

illuminance at the workplaces. By means of a CCD camera, in principle, shortcomings of the 
sensor discussed hereinabove can be eliminated by: 



Static masking: 

30 As the positions of the windows 1 in the image of the camera are known, the 

light observed in these positions can be excluded from the computation algorithm carried out 
by the control means. This can be manually adjusted or it can be an automatic (self-learning) 
process. At moments when the office lighting is not burning, for example, images are 
collected and an image is composed, possibly by means of contrast-improving techniques, of 
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the positions where a high brightness is observed. This image is frozen and used, at a later 
stage, in the data interpretation process to remove the disturbing positions of the windows 1 
(both the positions/solid angles and the light impressions thereof are ignored in the 
computation). Such a keying technique is also used, for example, in the color television 
5 technique where it is commonly referred to as "chroma keying" (color information keying; 
generally blue is chosen). Here, one type of information is substituted v^th another type of 
information, as is the case in the images of the weather forecaster: a blue background is 
substituted with the weather chart. 



1 0 Masking for light intensity: 

Direct sunlight entering through the windows 1 will lead to a light intensity in 
the paths 2 on the desk 3 where the sunlight is incident, which is much higher than the light 
intensity outside these paths. Upon reading out the image produced by the camera, a 
substantial surge in the video output signal 4 of video line I will be found exactly at the edges 

1 5 of these sunlight paths 2 (see Fig. 2). If this video output signal 4 exceeds a predetermined 
value 5, also these positions and light impressions can be keyed from the information flow, 
resulting in a processed output signal 6, as shown in Fig. 2. 

Such a technique is employed in, for example, "Closed Circuit Television" for 
20 traffic control purposes. In this manner, overshoot originating from, for example, headlights 
can be suppressed. Very bright lights are shown in black. In said field of application, the 
technique is referred to as "Peak White Invert". Thus, it can be readily understood that the 
disturbance of the light perception caused by a person in a very white shirt being visible on 
the image can also be eliminated, 

25 

The combination of the techniques described hereinabove can give a fairly 
good impression of the prevailing light values at the normal workplaces, because the most 
disturbing factors have been eliminated. 

30 Fig. 3 diagrammatically shows how this can be achieved. The comparator 

output 7 of the frozen image of the windows 1 as well as the comparator output T of the 
"live" image are jointly passed through an OR circuit, and the output is used to key the 
excessively bright lights from the "live" image signal 4 produced by the camera. If the resets 
11, 12 of the integrators 13, 14 take place at the beginning of the image, then the total light 
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value (without the bright lights) of the image will be present on integrator 14 at the end of the 
image duration, and the image duration over which averaging should not take place is present 
on integrator 13. The average light value (without bright hghts) thus is: 
^averaged = (Etotai) / (image duration-Tmm). 

5 

The daylight contribution, however, is not uniform throughout the office. In 
the Hghting technique this phenomenon is referred to as the dayUght factor. This factor 
describes a certain daylight reduction curve. Close to the window 1, the daylight contribution 
is larger, and it decreases as the distance to the window 1 increases. This is a non-linear 

1 0 curve. This daylight factor also depends on the season. By dividing the image of the sensor 
into, for example, two fields, i.e. one close to the window 1 and one at a larger distance from 
the window 1, which fields must additionally substantially coincide with the individual 
lighting from two individual rows of luminaires, it is thus possible to slightly compensate for 
this daylight gradient. Consequently, a camera can drive various control circuits 

15 simultaneously. In other words, a plurality of conventional sensors can be replaced by one 
camera which, in addition, performs better. 



Color recognition: 

Using a color CCD camera, certain decisions can also be made by using the 
20 color content. The information from a color CCD consists, in principle, of three images; one 
image for red, one image for green and one image for blue. By adding together these three 
components, using a certain weight factor for each component, an image showing the 
brightnesses (black-white) is obtained. This image can thus be subjected to the above- 
described processes. 

25 

The sunlight which directly enters the room, however, has a much higher 
component for red than for the other colors. Consequently, by suitably comparing this red 
component with the size of the other information, in principle, also the patches of direct 
sunlight can be recognized and hence an operation which is similar to that described with 
30 respect to "masking for light intensity" can be carried out. 

Controlling the color temperature: 

A color CCD also makes it possible to pronounce on the prevailing color 
temperature of the light. This information can thus also be used to build up a control circuit in 
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conjunction with luminaires, whereby the color temperature of the light can be regulated to 
control the Ught color temperature. Practical examples of this are: keeping the color 
temperature constant during dimming, or deliberately controlling a preferred setting of the 
employee, or imitating a daylight cycle in order to stimulate a higher productivity, etc. 

5 

To detect the presence of a person or persons in the office space (in order to 
switch the Ught on or off on the basis of this information), hitherto, use has been made of 
passive infrared detectors, ultrasound detectors or ordinary sound detectors or radar 
detection. These detection methods are in general use in security systems or automatic door 

10 openers. In fact, the detection techniques are all based on changing physical quantities, i.e. on 
moving objects which, in the former case, must emit heat and, in the latter case, must exhibit 
a certain absorption of electromagnetic fields (50 to 100 liters of water). The detectors used 
to automatically switch the light on or off are generally optimized for this application 
(mounted at the ceiling; the right sensitivity to detect people in a seated position which only 

1 5 move their hands) . 

In the currently used light switching systems and Ught control systems, where 
the artificial light should only be on when people are present in the room and, 
simultaneously, the amoimt of artificial light should be controllable in the case of daylight 
20 entering the room, it will be necessary to apply a combination of sensors (a presence sensor 
and a Ught sensor). 

Presence detection by means of a CCD camera: 

The use of video cameras for security reasons is commonly known. The fact 

25 that this video information can also be used to automatically generate an alarm is less well 
known, although in the past it was frequently applied to guard, for example, unmanned 
aircraft stationed at the apron. The technique used in this case is: a frame is drawn around the 
object to be guarded. The video content of the previous image (or previous images) at the 
location of this frame is compared with the new image. A clear difference between these 

30 images means that there is something or someone trying to penetrate this frame, as a result of 
which an alarm is generated. Such a technique can also be used to switch the lighting. 

An example hereof is shown in Fig, 4. A number of workplaces 15 are within 
the range of the CCD camera, which is mounted at the ceiling. Frames 16 are dravm around 



,PHNL000341 * ' . ■ 

7 14.05.2001 
the separately switchable lighting groups. If a person 17 enters such a frame, the video 
content will change at the location where the person 17 enters this frame. At the location of 
this change, a contour line 18 is drawn. If the person 17 is completely inside the frame 16, 
there is a closed contour hne 18 which encloses a certain surface area. If this surface area is 

5 sufficiently large, it may be assumed that this surface area denotes a person. The light will 
switch on. As long as this contour 1 8 (or a number of contours 1 8) is situated within this 
frame 16, the light remains on, even if the person 17 involved has fallen asleep behind his 
desk. In this example, the light switches on at image C and switches off at image G. Other 
well-known methods of object recognition by means of camera images can also be used of 

10 course. 

It will be obvious that this type of image processing requires a certain amount 
of light, because without light there is no image. In order to be able to produce an image in 
pitch-darkness, use can be made of infrared-emitting diodes (LEDs) or of other infrared light 
15 sources. This is a well-known technique employed in security cameras, where a complete 
array of IR LEDs is sometimes arranged around the lens of the camera. These light sources 
do not have to issue light continuously, one flash per image scan is sufficient. Obviously, in 
these cases the camera must be sensitive to near infrared light (850 or 950 nanometers). 

20 If present, such IR-LEDs can also be used for other tasks, such as the emission 

of infrared remote control codes or other data traffic. For remote control in general use can be 
made of various techniques. In the very beginning of remote control for television receivers, 
use was made of ultrasonic sound signals. Currently, most remote control devices for 
television receivers are based on infrared light. The already existing technology of radio 

25 frequency remote control has only just become available because international legislation 
regarding the use of these radio frequencies has been recently adapted. 
Both techniques require the use of fairly complex and extensive codes, because it should be 
possible to use these remote controls for various applications simultaneously in the same 
room. For example for television, video recorder, video projector, audio, awning and also for 

30 lighting. For radio-frequency applications, this space may even be very large because this 
radiation can also pass through walls. The range varies from 50 to 100 meters. 

In the applied infrared protocol (Philips-standard, RC-5), different code blocks 
are assigned to all these different applications, and, in the blocks used by Philips Lighting 
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Controls, sub-blocks are defined in order to be able to individually operate the different 
groups of lighting in a large room. The digital message thus contains information indicating 
for which system this message is intended as well as information indicating what should be 
done. Currently, to operate the lighting in offices, use is made of a division into eight 
5 sub-groups with fifteen independent commands per group. 

Remote control by means of the CCD camera: 

The scan frequency of a video camera is generally related to the electric mains 
fi-equency in order to preclude interference with the intensity variations of the light sources 

10 (lamps). For Europe this means 20 milliseconds per frame or 40 milliseconds per image. 

Consequently, the sample rate that can be achieved with a CCD camera is very low while, for 
ergonomic reasons, it must be possible to interpret a message within 250 milliseconds. It can 
be concluded thus that the current RC-5 protocol cannot be processed using a standard CCD 
camera. The RC-5 protocol, however, has too much "overhead" for the camera, since the 

1 5 camera is capable of locating the emitter (or the emission direction of the emitter). From this 
a substantial part of the meaning of the command can already be inferred. 

An emitter mounted near the door only has to be able, in principle, to emit two 
commands, namely: "light on" and "light off. The fact that the conunand "light on" means 

20 that in some cases the orientation lighting has to be switched on (so that people can find their 
way to the workplace) while, in other cases, it means that all lights must be switched on (for 
example for a cleaning service) is determined by the system by means of other information 
such as clock information. In the image of the camera, it would thus be possible to define an 
area (near the door), such that a light phenomenon which is modulated in a certain way can 

25 have these meanings when it is observed in said area. 

If it is desirable to also assign room temperature fimctions to this emitter, then 
only two commands have to be added, namely: "heating on" and "heating off. Consequentiy, 
all in all there are only 4 commands. 



30 



For mobile emitters which can be used at the workplace, more possibilities are 
generally desired, such as: "light situation 1"; "light situation 2"; "light situation 3" and "light 
off. If also the awning fimctions are added: "up"; "stop" and "down", the total number of 
commands is seven. 
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If the camera sees a certain light modulation within a frame comprising the 
workplace, as already indicated in the example of Fig. 4, then this command is carried out for 
this workplace. Such a signal taking place outside a frame has no meaning and, consequently, 
5 is not carried out. 

From the foregoing it can be derived that the number of necessary messages 
can be very limited actually. A simple 3-of-5 code already enables ten different messages to 
be conveyed: 
10 5!/ (3!* (5-3)0 = 10. 

Thus, if the message relates to a frame of seven samples, the first one of which 
must always be a "1", and subsequently five sample slots, only three of which may contain a 
"1", and the seventh sample always is a "0", then a message can be conveyed in seven 
1 5 samples. This would require maximally 280 milliseconds. 

It has been described hereinabove that it could be interesting to provide the 
CCD camera with IR-LEDs, If the remote control emitters are also provided with a IR 
receiver, then these emitters can, for example, also be synchronized by the camera or they 
20 can be given a different function, or a setting can be changed (for example of the temperature 
emitter), or the emitter can be questioned (the output of the emitter only has to be "yes" or 
"no" in this case). This results in many more practical possibilities. 



